Protocol
Abstract
Background: Major depressive and anxiety disorders affect 61 million adults in the United States. People living with mental illness, including depression and anxiety, experience stigma associated with the illness and receiving treatment for their illness. Stigma refers to negative attitudes or beliefs about mental illness or negative behaviors directed toward persons with mental illness. Stigma is a leading and fundamental cause of health inequities. Contact interventions, which are premised on the idea that positive and voluntary contact with persons with mental illness can effectively reduce mental illness stigma, are aimed at reducing stigma and improving health outcomes. Video-based interventions improve knowledge, attitudes, and behavior in the short term, and there is a need for randomized controlled trials of indirect contact or video-based contact interventions to address stigma and engagement in mental health services.
Objective: The aim is to assess the feasibility and acceptability and test the preliminary efficacy of a self-administered video-based mobile app in reducing mental illness stigma among Black adults with moderate to severe depression or anxiety.
Methods: The intervention will involve short videos (6-12 minutes in length) of patients describing personal narratives of mental illness, treatment, and recovery and will be delivered over 4 weeks, with 2 booster sessions in weeks 6 and 12. Study participants (N=90) will be randomly assigned to 1 of 3 treatment arms: a standard video-based app (n=30), a video-based app modified with a concordant patient video (n=30), and a waitlist control (n=30).
Results: We hypothesize the concordant and standard intervention group will have greater mental health service use, lower stigma, and lower mistrust compared to the waitlist arm. As a feasibility study, we will pilot the outcome analyses (to detect a signal and estimate direction of analysis). On the basis of the sample size of 90 (n=30 in each treated group and control group) and power at 72%, we will be able to detect a medium effect size of Cohen d=0.49 at α=.05 for comparing the intervention versus control proportions for any engagement in mental health care services.
Conclusions: Given the low uptake of mental health services for people experiencing early signs and emerging symptoms of mental illness, efforts to increase early access to mental health services will be met with ongoing substantial barriers to mental health care use if stigma and medical mistrust are left unaddressed. Data from this pilot and feasibility randomized controlled trial will provide critical information about the feasibility and acceptability of this intervention and preliminary efficacy estimates. This study will fill a critical public health gap created by the stigma that leads to delayed diagnosis, delayed entry into mental health treatment, and increased morbidity and mortality related to mental illness.
Trial Registration: ClinicalTrials.gov NCT06316804; https://clinicaltrials.gov/study/NCT06316804
International Registered Report Identifier (IRRID): DERR1-10.2196/81645
doi:10.2196/81645
Keywords
Introduction
Background
Major depressive and anxiety disorders affect 61 million adults in the United States [-]. People living with mental illness, including depression and anxiety, experience stigma associated with the illness and receiving treatment for their illness [,]. Stigma, which refers to negative attitudes or beliefs about mental illness or negative behaviors directed toward persons with mental illness [,], is a leading and fundamental cause of health inequities [-]. The primary mechanisms through which stigma worsens mental health outcomes include delayed treatment seeking and limited access to care [,]. Contact interventions, which are premised on the idea that positive and voluntary contact with persons with mental illness can effectively reduce mental illness stigma [,,], are aimed at reducing stigma and improving health outcomes. Past studies show face-to-face contact is superior to video-based contact; however, more recent randomized controlled trials (RCTs) show that video-based contact has a comparable effect in reducing stigma [,,-]. Video-based interventions improve knowledge, attitudes, and behavior in the short term, and there is a need for RCTs of indirect contact or video-based contact interventions to address stigma and engagement in mental health services [,,,].
Interventions to reduce mental illness stigma among Black adults remain understudied [,-], and the role of mistrust is rarely examined []. There is a need for methodologically strong research to develop scalable interventions to reduce stigma and address medical mistrust, thus potentially increasing mental health service use [,,]. Concomitant with these known gaps in the current literature, we developed iteratively and using a co-design user-centered design model, a mobile intervention platform to reduce stigma, address medical mistrust, and increase mental health service engagement among Black adults. In this study protocol manuscript, we present on the planned protocol for a novel randomized controlled intervention, testing the feasibility and acceptability of an antistigma mental health intervention delivered remotely on a digital mental health platform.
Several forms of stigma are prominent among persons with mental illness and contribute to increased psychological distress [,,,-]: enacted stigma—the behavioral manifestations of negative attitudes about persons with mental illness, including stereotyping, social distancing, prejudice, and discrimination [,]; anticipated stigma—the expectation that one will be devalued for having mental illness and/or being subjected to stereotyping, prejudice, or discrimination if one’s mental illness were to become known by others [,-]; and internalized stigma—endorsing the negative attitudes and beliefs as valid, thereby developing self-defacing beliefs about oneself [,]. Among Black adults, the content of mental health stigma includes beliefs that mental illness is attributed to a lack of faith in God, weakness, or lack of self-control [-]. However, current research studies approach Black adults as a homogenous group, and this assumption of homogeneity limits the efficacy of programs that seek to reduce mental illness stigma among Black adults in the United States [-]. Previous studies show that concordance in sociodemographic factors including race, ethnicity, and religiosity may improve the acceptability and efficacy of antistigma contact interventions [].
Mobile mental health apps offer a mechanism to deliver interventions that can be modified in real time to align with user characteristics (such as race, ethnicity, or religious background) [-]. The largest systematic reviews and meta-analysis on stigma interventions to date have called for more culturally informed approaches to the design of stigma interventions [,,,,]. In addition, concordance (eg, in race or ethnicity) between patients and providers is associated with higher trust, improved communication, and higher intent to adhere to health services [-]. Medical mistrust may be directed toward health professionals or health systems and is a known barrier to engagement in mental health services for the Black population [,,]. Antistigma interventions that simultaneously address medical mistrust may have enhanced efficacy [,-]. Previous studies show that having health professionals of shared racial, ethnic, or religious backgrounds would reduce their hesitancy toward accessing mental health services [,,].
Study Objective
The main study objective is to address mental health gaps around the role of stigma in reducing mental health service engagement by assessing a mobile app, codeveloped with end users. The user-centered design phase involved usability testing to refine intervention components to meet the needs and preferences of end users through an iterative, stepwise design process. Given the high stigma among underserved populations including Black adults with mental illness, screened participants in the user-centered design study reported a preference for key informant interviews over focus groups. A separate paper has been published on the app development of the intervention that is being tested and reported on in this protocol study manuscript. This paper describes the protocol for a 3-arm randomized controlled waitlist trial to assess the feasibility and preliminary efficacy of an antistigma mobile mental health app, which integrates components that address the mistrust of health systems, in reducing mental illness stigma among Black adults with moderate to severe depression or anxiety.
Conceptual Framework
The conceptual model for stigma reduction is based on well-established sociological and psychological theories of behavior change. This model predicts that positive and voluntary contact with people living with mental illness can effectively reduce stigmatizing attitudes and stigmatizing behaviors [,,]. On the basis of extensive research conducted by Corrigan et al [], successful contact interventions have the following characteristics: targeted (ie, at a specific outcome, such as the use of mental health services); local (within a geographical region such as an urban setting); credible (ie, to the target group); continuously delivered (ie, not a single point of contact); and involves contact (closing the social gap between people with stigma and people living with mental illness through direct [in person] or indirect [video based or virtual] means).
Meta-analyses have consistently shown that both face-to-face and video-based contact with people living with mental illness can reduce stigma. In contrast to video-based contact, face-to-face interventions require intensive professional or peer facilitators, which significantly limits scaling, dissemination, and implementation goals [,,]. The delivery of face-to-face stigma-reducing interventions can potentially be addressed by use of mobile mental health technology to deliver video-based interventions. Recent RCTs of interventions that optimize the core underpinnings of video contact show that video-based contact has similar efficacy as face-to-face contact [,,-].
Methods
Hypotheses
We hypothesize the concordant and standard intervention group will have greater mental health service use, lower stigma, and lower mistrust compared to the waitlist arm. We also hypothesize that among the two intervention groups, the concordant intervention group will have greater effects on the primary and secondary outcomes compared to the standard intervention group.
Study Design and Setting
The study follows a single blind design among 2 experimental arms and 1 waitlist control arm. Participants are unaware of which intervention arm they are assigned among the two experimental arms. It was not feasible to fully blind the participants to the intervention versus waitlist arms, but we are able to blind participants to the specific content of the two intervention arms.
The intervention will involve short videos (6-12 minutes in length) of patients describing personal narratives of mental illness, treatment, and recovery and will be delivered over 4 weeks, with 2 booster sessions in weeks 6 and 12. Study participants (N=90) will be randomly assigned to 1 of 3 arms: a standard video-based app (n=30), a video-based app modified with a concordant patient video (n=30), and a waitlist control (n=30).
The study team used the SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) checklist in the development of the study protocol and conceptualization of the study and as study activities were initiated. We have included the page reference numbers for the SPIRIT checklist. The study team will follow the CONSORT (Consolidated Standards of Reporting Trails) checklist criteria throughout the study, including randomization scheme, study procedures, and planned analysis.
Intervention Overview
Intervention Format
This study consists of a self-administered video-based stigma reduction app using an RCT design among Black adults (ages 18-45 years) from diverse ethnic backgrounds with moderate to severe depression and/or anxiety (9-item Patient Health Questionnaire ³10 or 7-item generalized anxiety disorder ³10) who have not accessed mental health services in the past year.
The intervention videos involve 6- to 12-minute videos, offering narratives on treatment and recovery by people living with mental illness from diverse backgrounds including narratives of depression illness and recovery [,]. In the adapted (concordant) intervention arm, participants will be offered video content from someone with the same or similar sociodemographic background based on their reported characteristics at screening []. The standard (discordant) intervention arm will involve video content from someone from a different sociodemographic background. The 2 intervention conditions will be delivered on a secure HIPAA (Health Insurance Portability and Accountability Act)-compliant platform. Content will be available in English at an eighth-grade reading level [,]. New sessions will be prompted each week based on the experimental condition arm, and usage data will be collected. The study will include individuals from various age groups, education and income levels, and gender identities. Study participants will be randomly assigned to 1 of 3 arms: a standard video-based app (n=30), a video-based app modified with a concordant individual (n=30), and a waitlist control (n=30).
Setting, Participants, and Eligibility Criteria
Recruitment will take place through the Massachusetts General Hospital patient registry, online social media advertising, and in partnership with community-based organizations. All participants will be prescreened via a phone call and/or an online form. All participants will complete an orientation call prior to randomization. To ensure representativeness of the sample, we will use a stratified random sampling of study participants to include equitable numbers of genders, migrant status, and ethnic origin (African Americans, African immigrants, Afro-Caribbean immigrants, and Afro-Latina). The participant eligibility criteria are shown in .
Inclusion criteria
- Black adults with moderate to severe depression (9-item Patient Health Questionnaire ³10) or anxiety (7-item generalized anxiety disorder ³10) who are not receiving routine mental health care
- Aged 18 to 45 years at time of screening. This age range was chosen due to variability in technology across age groups, reducing the heterogeneity of technology use among participants.
- English speaking
- Own a smartphone and have internet access
Exclusion criteria
- Visual, hearing, voice, or motor impairments that would prevent engagement in study procedures
- Diagnosis of psychotic disorder or severe suicidality for which participation would be inappropriate
Language variance and lack of access to a smartphone would prevent engagement in study procedures and impact feasibility assessment.
Procedure
At the initial visit, we will obtain baseline measurements of enacted, anticipated, and internalized stigma []. The self-administered intervention will be delivered over 4 weeks based on the experimental condition, and participants will each receive a standard video-based intervention or a concordant video-based intervention. Each week, participants will be prompted with a notification (via SMS text message and/or email) to access that week’s intervention components. The content of booster sessions in weeks 6 and 12 will be based on the experimental arm and will contain repeat sessions used in each experimental arm. The waitlist arm will receive the concordant video condition after 12 months. At the orientation visit, for all participants, guidance on obtaining emergent or urgent services is provided, including reaching out to the study team (which includes a social worker, resource specialist, and psychiatrist) at any time.
Recruitment
Patients who present for general medical care at the selected Mass General Brigham community clinic partners are routinely given screening tests (9-item Patient Health Questionnaire and 7-item generalized anxiety disorder). The community advisory board will support recruitment efforts. Flyers and announcements will be available in clinics and shared with community partners. Any participant who meets the entry criteria on screening tests and who may have declined mental health services will be offered the stigma intervention program. If a patient agrees to participate, a trained research assistant will contact the patient. In addition, using the electronic medical records, patients who meet the criteria within the last 12 months and have not received mental health services in the past year will be invited to participate in the eligibility screening. The waitlist arm will receive holiday cards and text reminders to complete assessments. Incentives to participate in the stigma intervention include offering a low intensity, nonjudgmental, and confidential option to patients who have screened positive for depression or anxiety but who are not receiving routine mental health care. To manage attrition in app use, which is common, we will send out weekly reminders using multiple methods such as email, text, and phone call reminders for participants missing study activities or assessments.
Assessments
Study recruitment and retention rates will be assessed to determine the feasibility of study procedures (). The feasibility outcomes will be measured based on acceptability of the study through measures of usability: System Usability Scale (SUS) and usefulness, satisfaction, and ease of use (USE) scales [,]. We will also document adherence based on time spent on the intervention program and app use data to assess the completion of video activities. Assessments will be completed using standardized measures ().
| Domain, construct, and measure | Baseline | Each week | After the booster | Follow-up at 6-12 months | ||||||
| Feasibility outcomes | ||||||||||
| Acceptability | ||||||||||
| USEa and SUSb | ✓ | ✓ | ✓ | |||||||
| Retention to intervention | ||||||||||
| Completed assessments | ✓ | ✓ | ✓ | |||||||
| Adherence to intervention | ||||||||||
| App metrics | ✓ | ✓ | ✓ | |||||||
| Primary outcomes | ||||||||||
| Demographic | ||||||||||
| Survey | ✓ | |||||||||
| Any engagement with mental health services | ||||||||||
| EMRc | ✓ | ✓ | ||||||||
| Secondary outcomes | ||||||||||
| Sigma scores | ||||||||||
| RIBSd and ISMIe | ✓ | ✓ | ✓ | ✓ | ||||||
| Help-seeking behavior | ||||||||||
| GHSQf | ✓ | ✓ | ✓ | ✓ | ||||||
| Medical mistrust scores | ||||||||||
| GBMMSg | ✓ | ✓ | ✓ | ✓ | ||||||
| Targets | ||||||||||
| Sigma and medical mistrusts | ||||||||||
| RIBS, ISMI, and GBMMS | ✓ | ✓ | ✓ | ✓ | ||||||
aUSE: usefulness, satisfaction, and ease of use.
bSUS: System Usability Scale.
cEMR: electronic medical record.
dRIBS: Reported and Intended Behavior Scale.
eISMI: Internalized Stigma of Mental Illness.
fGHSQ: General Help-Seeking Questionnaire.
gGBMMS: Group-Based Medical Mistrust Scale.
Data Analysis and Power Calculation
As a feasibility study, we will pilot the outcome analyses (to detect a signal and estimate direction of analysis), recognizing that the trial may be underpowered. On the basis of the sample size of 90 (n=30 in each treated group and control group) and power at 72%, we will be able to detect a medium effect size of Cohen d=0.49 at α=.05 comparing the intervention versus control proportions for any engagement in mental health care services.
For the continuous outcomes (such as Group-Based Medical Mistrust Scale), we will use generalized linear mixed models with a gamma distribution for continuous outcomes. If variables are not normally distributed, we will explore a transformation. For binary outcomes, we will use Poisson or negative binomial regression depending on the variance.
Randomization and Blinding
Randomization Scheme
Participants will be randomized to 1 of 3 arms: a standard video contact arm, a concordant video contact arm, and a waitlist control arm as outlined in our CONSORT diagram (). Assignment to the 3 arms in a 1:1:1 allocation ratio will be determined centrally by the principal investigator according to a computer-generated random schedule (ie, in Stata [StataCorp]). There is no practical way to fully blind the study participants to treatment assignment versus waitlist and accomplish the objectives of the study. To avoid bias among participants receiving the concordant or standard video assignment, we will conceal treatment arm allocation. We are testing the salience of concordance across sociodemographic characteristics; unblinding would prevent unbiased testing of the role of concordance. The study participants will be blinded to the two intervention arms and will be unaware which intervention arm they were assigned throughout the study. The research study staff and biostatistician (who will be conducting the outcome assessments and analysis, respectively) will be blinded to treatment assignment status. The participants assigned to the waitlist will receive access to the concordant video contact intervention after they have completed their 12-month study assessment. To avert chance imbalances by ethnicity and sex, we will stratify randomization by ethnicity (African American, Afro-Caribbean or Afro-Latino, and African immigrant) and sex. The regression models for the primary analysis include the stratification variables as covariates to ensure the estimated standard errors are accurate. We hypothesize that the concordant video arm will be superior to the standard video arm. The standard video arm is needed to test our hypothesis and understand the mechanistic effect of each therapeutic target.
Reliability and validity data for the study assessments are shown in [-].

| Variables | Reliability and validity | Estimated administration time |
| 4-item Reported and Intended Behavior Scale (Evans-Lacko et al [], 2011) |
| 2 minutes |
| 29-item Internalized Stigma of Mental Illness (Boyd et al [], 2014) |
| 4-6 minutes |
| 12-item Group-Based Medical Mistrust Scale (Shelton et al [], 2010) |
| 3-5 minutes |
| 20-item General Help-Seeking Questionnaire (Ibrahim et al [], 2019) |
| 3-5 minutes |
aISMI: Internalized Stigma of Mental Illness.
bGBMMS: Group-Based Medical Mistrust Scale.
Missing Data
Data missing at follow-up could bias study findings. We plan to record the reason for dropout. When dropout occurs completely at random, the statistical analyses stated will provide appropriate statistical inferences. The multiple imputation approach will be conducted for follow-up data that are missing at random.
Planned and Interim Analysis
We hypothesize that the contact-based intervention arm that incorporates an approach using concordance will reduce stigma and lower medical mistrust, improving engagement in mental health services. Feasibility will be assessed by meeting our recruitment goals (90 participants), obtaining 80% of follow-up self-report data, and having a dropout rate of <20% in one or more treatment conditions, which is in line with previous mobile mental health intervention RCTs [] and which would indicate the treatment format for future research. Recruitment and retention rates, acceptability, adherence to study, and treatment will be reported as percentages. The average USE and SUS scores will be reported.
We will assess the moderating role of sociodemographic factors (religiosity, migrant status, and socioeconomic status) by controlling for these variables in our pre-post assessments.
Ethical Considerations
This study has been approved by the institutional review board (IRB) of Massachusetts General Brigham (2022P000580). Full informed consent will be obtained by the principal investigator (a licensed physician) prior to study activities. A data safety monitoring board is not needed for a minimal risk intervention (IRB determination). This study was registered on ClinicalTrials.gov (NCT06316804).
Protocol deviations are documented and reported to the IRB and sponsor based on Massachusetts General Brigham IRB policy. Minor deviations are reported at continuing review based on the designated timeline by the IRB. Any major deviations are reported at time of identifying the deviation based on the IRB policy. All participants will complete a virtual orientation visit (prior to baseline assessment). At this visit, waitlist participants and intervention participants are provided guidance on obtaining emergent or urgent referral services, including reaching out to the study team (which includes a social worker, resource specialist, and psychiatrist) at any time throughout the study period.
All participants complete full informed consent prior to study activities. The study is voluntary and participants may discontinue participation at any time. The study team will ensure participants are able to safely discontinue participation. Only deidentified information is used for analysis and publication purposes. To help with retention, starting at US $20 for the initial baseline assessment, we will offer a graded compensation schedule with US $5 to US $10 increments for subsequent assessments completed.
Data Dissemination and Data Availability
The study results will be presented at conferences and in relevant journals. After data collection and initial analysis is completed and published, data will be managed based on sponsor (National Institutes of Health) data management and privacy policy. Deidentified data will be available in accordance with the National Institute of Mental Health Data Archive policy and timeline.
Results
Study Status
The study was funded on August 16, 2022. Initial activities involved app design. Following app design, clinical trial activities will be initiated. As of submission of the manuscript, 75 of 90 participants were successfully recruited. Study results will be published in March 2027.
Study Outcomes
Our study will assess our ability to recruit and retain study participants and measure usability, satisfaction, and adherence. The primary outcome will be mental health service use, assessed 4 weeks after the intervention and at 3 months after the booster sessions and again at 6 and 12 months, following booster sessions. Secondary outcomes will include anticipated, enacted, and internalized stigma; medical mistrust; and help-seeking behavior. The primary outcome is defined as any engagement with mental health services: this includes intake appointments, follow-up appointments, or scheduled appointments for mental health with a psychiatrist, physician or clinician, clinical psychologist, therapist, or self-report mental health service use (verified by electronic health records). At baseline, participants sign a release of information (ROI) form to allow the study team to obtain their medical records from their designated health system. The ROI form expires at 6 months, and a new ROI will be obtained to ensure the study team is able to retrospectively review use of mental health services at study completion at 12 months.
Data Collection and Outcomes
Data collection will be done through a secure Research Electronic Data Capture (REDCap; Vanderbilt University) database. Our app platform allows us to track and collect data on app engagement and usage metrics.
The secondary outcomes will be anticipated, enacted, and internalized stigma; medical mistrust; and self-reported help-seeking behavior. Feasibility outcomes will be assessed, including acceptability (USE and SUS), adherence (use metrics), and retention in the study (online assessments completed). We define a priori targets for the SUS and USE scales as usability scores >70, indicating good to excellent usability and mean scores on the USE scales (comparing the two experimental arms). We will measure study adherence based on the number of app logins and target at least one video session and assessment completed.
Discussion
Expected Findings
Black adults are known to have lower use of mental health services. In light of the increasing use of mobile devices, a self-administered antistigma mobile app has the potential to enhance accessibility and scalability of traditionally difficult to access stigma reduction tools. This manuscript describes the study protocol for an ongoing RCT to assess 2 intervention arms (a concordant and standard video-based stigma-reducing mobile app) compared with a waitlist control group. We hypothesize that individuals assigned to the intervention groups will be more likely to choose to engage in mental health services and report decreased stigma and decreased mistrust compared with the waitlist control group. Additional secondary outcomes will allow an estimate of the extent to which changes in anticipated or enacted or internalized stigma and medical mistrust mediate the intervention’s effect on the primary and secondary outcomes. Mediation analysis will be conducted to assess whether stigma (Reported and Intended Behavior Scale and Internalized Stigma of Mental Illness) and medical mistrust (Group-Based Medical Mistrust Scale) are potential mediators in the pathway between engagement in mental health care and the intervention [,,,,]. Causal mediation analyses will be conducted to assess the relationships. The direct and indirect effects from the causal mediation analyses will be estimated. Percent of total mediation effect and 95% CI from each causal mediation analysis will be provided. We will use the SAS (SAS Institute) procedure CAUSALMED based on methods developed by Valeri and Vanderweele [].
Study Status
This is an ongoing randomized controlled clinical trial. Recruitment of participants started in July 2024 and is expected to be completed in July 2026 for the 1-year surveillance follow-up. The study is currently under protocol version 3 (approved in December 2024).
Future Directions
Given the low uptake of mental health services for people experiencing early signs and emerging symptoms of mental illness, efforts to increase early access to mental health services will be met with ongoing significant barriers to mental health care use if stigma and medical mistrust are left unaddressed. Data from this pilot and feasibility randomized trial will provide critical information about the feasibility and acceptability of this intervention and preliminary efficacy estimates.
Limitations
The sample size is insufficient to definitively test the effectiveness of the intervention for the primary outcomes. However, prior to making large investments in this line of study, delineating mechanistic targets and identifying key outcome assessments and measures will be critical to informing future investment in fully powered RCTs and implementation studies. The use of mobile technology varies across age groups. To address this limitation, we have chosen to include a narrow age group (aged 18-45 years) while we test the feasibility and acceptability of the mobile app.
Conclusions
Despite the limitations, the next step is to further refine the intervention (based on this clinical trial) for testing in a fully powered randomized controlled effectiveness trial. Future studies will be adequately informed on the refined approach in testing the effectiveness and implementation of this mobile app and other similar mobile health apps across disease conditions and across populations at risk of worsening of disease due to treatment hesitancy and high stigma. While the study is underpowered to test effectiveness, this study will fill a critical public health gap created by the stigma that leads to delayed diagnosis, delayed entry into mental health treatment, and increased morbidity and mortality related to mental illness.
Funding
ABP reports funding from US National Institutes of Health (K23MH128535).
Authors' Contributions
ABP was responsible for conceptualization, data curation, formal analysis, funding acquisition, investigation, methodology, project administration, resources, software, supervision, validation, visualization, and writing of the paper.
Conflicts of Interest
ABP reports receiving financial compensation for educational consultation from Otsuka, Apple Inc, and Quality Interactions.
References
- Major depression. National Institute of Mental Health. URL: https://www.nimh.nih.gov/health/statistics/major-depression.shtml [accessed 2020-12-30]
- What is depression? Anxiety & Depression Association of America. URL: https://adaa.org/understanding-anxiety/depression [accessed 2020-12-30]
- Dattani S, Rodés-Guirao L, Ritchie H, Roser M. Mental health. Our World in Data. 2023. URL: https://ourworldindata.org/mental-health [accessed 2025-11-20]
- Thornicroft G, Mehta N, Clement S, Evans-Lacko S, Doherty M, Rose D, et al. Evidence for effective interventions to reduce mental-health-related stigma and discrimination. The Lancet. Mar 12, 2016;387(10023):1123-1132. [CrossRef]
- McCullock SP, Scrivano RM. The effectiveness of mental illness stigma-reduction interventions: a systematic meta-review of meta-analyses. Clin Psychol Rev. Mar 2023;100:102242. [CrossRef] [Medline]
- Corrigan PW, Morris SB, Michaels PJ, Rafacz JD, Rüsch N. Challenging the public stigma of mental illness: a meta-analysis of outcome studies. Psychiatr Serv. Oct 2012;63(10):963-973. [CrossRef] [Medline]
- Amsalem D, Jankowski SE, Yanos P, Yang LH, Markowitz JC, Rogers RT, et al. Randomized controlled trial of a brief video intervention to reduce self-stigma of mental illness. J Clin Psychiatry. Mar 06, 2024;85(1):23m15034. [CrossRef] [Medline]
- Fox AB, Earnshaw VA, Taverna EC, Vogt D. Conceptualizing and measuring mental illness stigma: the mental illness stigma framework and critical review of measures. Stigma Health. Nov 2018;3(4):348-376. [FREE Full text] [CrossRef] [Medline]
- Kolb K, Liu J, Jackman K. Stigma towards patients with mental illness: an online survey of United States nurses. Int J Ment Health Nurs. Feb 2023;32(1):323-336. [CrossRef] [Medline]
- Hatzenbuehler ML, Phelan JC, Link BG. Stigma as a fundamental cause of population health inequalities. Am J Public Health. May 2013;103(5):813-821. [FREE Full text] [CrossRef] [Medline]
- Adu J, Oudshoorn A, Anderson K, Marshall CA, Stuart H. Social contact: next steps in an effective strategy to mitigate the stigma of mental illness. Issues Ment Health Nurs. May 2022;43(5):485-488. [CrossRef] [Medline]
- Cerully JL, Collins RL, Wong E, Seelam R, Yu J. Differential response to contact-based stigma reduction programs: perceived quality and personal experience matter. Psychiatry Res. Jan 2018;259:302-309. [CrossRef] [Medline]
- Koike S, Yamaguchi S, Ojio Y, Ohta K, Shimada T, Watanabe K, et al. A randomised controlled trial of repeated filmed social contact on reducing mental illness-related stigma in young adults. Epidemiol Psychiatr Sci. Apr 2018;27(2):199-208. [FREE Full text] [CrossRef] [Medline]
- Vinson ES, Abdullah T, Brown TL. Mental illness stigma intervention in African Americans: examining two delivery methods. J Nerv Ment Dis. May 2016;204(5):400-403. [CrossRef] [Medline]
- Mehta N, Clement S, Marcus E, Stona AC, Bezborodovs N, Evans-Lacko S, et al. Evidence for effective interventions to reduce mental health-related stigma and discrimination in the medium and long term: systematic review. Br J Psychiatry. Nov 2015;207(5):377-384. [FREE Full text] [CrossRef] [Medline]
- Makhmud A, Thornicroft G, Gronholm PC. Indirect social contact interventions to reduce mental health-related stigma in low- and middle-income countries: systematic review. Epidemiol Psychiatr Sci. Nov 09, 2022;31:e79. [FREE Full text] [CrossRef] [Medline]
- Yamaguchi S, Wu SI, Biswas M, Yate M, Aoki Y, Barley EA, et al. Effects of short-term interventions to reduce mental health-related stigma in university or college students: a systematic review. J Nerv Ment Dis. Jun 2013;201(6):490-503. [CrossRef] [Medline]
- Subica AM, Link BG. Mental illness stigma in Black, Latina/o, and Asian Americans. J Racial Ethn Health Disparities. Feb 2026;13(1):463-474. [CrossRef] [Medline]
- Misra S, Jackson VW, Chong J, Choe K, Tay C, Wong J, et al. Systematic review of cultural aspects of stigma and mental illness among racial and ethnic minority groups in the United States: implications for interventions. Am J Community Psychol. Dec 2021;68(3-4):486-512. [CrossRef] [Medline]
- Powell W, Richmond J, Mohottige D, Yen I, Joslyn A, Corbie-Smith G. Medical mistrust, racism, and delays in preventive health screening among African-American men. Behav Med. 2019;45(2):102-117. [FREE Full text] [CrossRef] [Medline]
- Rodríguez-Rivas ME, Cangas AJ, Martin A, Romo J, Pérez JC, Valdebenito S, et al. Reducing stigma toward people with serious mental illness through a virtual reality intervention: a randomized controlled trial. Games Health J. Feb 2024;13(1):57-64. [CrossRef] [Medline]
- Quinn DM, Earnshaw VA. Concealable stigmatized identities and psychological well-being. Soc Personal Psychol Compass. Jan 2013;7(1):40-51. [FREE Full text] [CrossRef] [Medline]
- Ritsher JB, Phelan JC. Internalized stigma predicts erosion of morale among psychiatric outpatients. Psychiatry Res. Dec 30, 2004;129(3):257-265. [CrossRef] [Medline]
- Goetz CJ, Mushquash CJ, Maranzan KA. An integrative review of barriers and facilitators associated with mental health help seeking among indigenous populations. Psychiatr Serv. Mar 01, 2023;74(3):272-281. [CrossRef] [Medline]
- Link BG, Cullen FT, Frank J, Wozniak JF. The social rejection of former mental patients: understanding why labels matter. Am J Sociol. May 1987;92(6):1461-1500. [CrossRef]
- Tan KK, Treharne GJ, Ellis SJ, Schmidt JM, Veale JF. Enacted stigma experiences and protective factors are strongly associated with mental health outcomes of transgender people in Aotearoa/New Zealand. Int J Transgend Health. Oct 12, 2021;22(3):269-280. [FREE Full text] [CrossRef] [Medline]
- Quinn DM, Earnshaw VA. Understanding concealable stigmatized identities: the role of identity in psychological, physical, and behavioral outcomes. Soc Issues Policy Rev. Dec 14, 2011;5(1):160-190. [CrossRef]
- Link BG, Cullen FT, Struening E, Shrout PE, Dohrenwend BP. A modified labeling theory approach to mental disorders: an empirical assessment. Am Sociol Rev. Jun 1989;54(3):400-423. [CrossRef]
- O'Donnell AT, Foran AM. The link between anticipated and internalized stigma and depression: a systematic review. Soc Sci Med. May 2024;349:116869. [FREE Full text] [CrossRef] [Medline]
- Pederson AB, Hawkins D, Lartey L. Descriptive analysis of social determinant of mental health factors in an ethnically diverse Black adult population. medRxiv. Preprint posted online on October 29, 2021. 2026. [FREE Full text] [CrossRef]
- Bamgbose Pederson A, Waldron EM, Fokuo JK. Perspectives of Black immigrant women on mental health: the role of stigma. Womens Health Rep (New Rochelle). 2022;3(1):307-317. [FREE Full text] [CrossRef] [Medline]
- Pederson AB, Konadu Fokuo J, Thornicroft G, Bamgbose O, Ogunnubi OP, Ogunsola K, et al. Perspectives of university health care students on mental health stigma in Nigeria: qualitative analysis. Transcult Psychiatry. Apr 2023;60(2):272-285. [FREE Full text] [CrossRef] [Medline]
- Pederson AB, Earnshaw VA, Lewis-Fernández R, Hawkins D, Mangale DI, Tsai AC, et al. Religiosity and stigmatization related to mental illness among African Americans and Black immigrants: cross-sectional observational study and moderation analysis. J Nerv Ment Dis. Feb 01, 2023;211(2):115-124. [FREE Full text] [CrossRef] [Medline]
- Williams DR, González HM, Neighbors H, Nesse R, Abelson JM, Sweetman J, et al. Prevalence and distribution of major depressive disorder in African Americans, Caribbean Blacks, and non-Hispanic Whites: results from the National Survey of American Life. Arch Gen Psychiatry. Mar 2007;64(3):305-315. [FREE Full text] [CrossRef] [Medline]
- Pederson AB, Hawkins D, Lartey L. Differences in psychosocial factors of mental health in an ethnically diverse Black adult population. J Public Health Policy. Dec 2022;43(4):670-684. [FREE Full text] [CrossRef] [Medline]
- Bijou C, Colen CG. Shades of health: skin color, ethnicity, and mental health among Black Americans. Soc Sci Med. Nov 2022;313:115387. [FREE Full text] [CrossRef] [Medline]
- Amuta-Jimenez AO, Jacobs W, Smith G. Health disparities and the heterogeneity of Blacks/African Americans in the United States: why should we care? Health Promot Pract. Jul 26, 2020;21(4):492-495. [CrossRef] [Medline]
- Yeo G, Reich SM, Liaw NA, Chia EY. The effect of digital mental health literacy interventions on mental health: systematic review and meta-analysis. J Med Internet Res. Feb 29, 2024;26:e51268. [FREE Full text] [CrossRef] [Medline]
- Timakum T, Xie Q, Song M. Analysis of e-mental health research: mapping the relationship between information technology and mental healthcare. BMC Psychiatry. Jan 25, 2022;22(1):57. [FREE Full text] [CrossRef] [Medline]
- Taylor C, Graham AK, Flatt RE, Waldherr K, Fitzsimmons-Craft EE. Current state of scientific evidence on internet-based interventions for the treatment of depression, anxiety, eating disorders and substance abuse: an overview of systematic reviews and meta-analyses. Eur J Public Health. Jul 07, 2021;31(31 Suppl 1):i3-10. [FREE Full text] [CrossRef] [Medline]
- Almuqrin A, Hammoud R, Terbagou I, Tognin S, Mechelli A. Smartphone apps for mental health: systematic review of the literature and five recommendations for clinical translation. BMJ Open. Feb 11, 2025;15(2):e093932. [FREE Full text] [CrossRef] [Medline]
- Rubeis G. E-mental health applications for depression: an evidence-based ethical analysis. Eur Arch Psychiatry Clin Neurosci. Apr 01, 2021;271(3):549-555. [CrossRef] [Medline]
- Mpompola T, Zartaloudi A, Mantoudi A, Mantzorou M, Apostolara P, Adamakidou T. Attitudes of healthcare professionals working in primary healthcare towards people with mental illness: a systematic review. Adv Exp Med Biol. 2026;1490:269-280. [CrossRef] [Medline]
- Greenwood BN, Hardeman RR, Huang L, Sojourner A. Physician-patient racial concordance and disparities in birthing mortality for newborns. Proc Natl Acad Sci U S A. Sep 01, 2020;117(35):21194-21200. [FREE Full text] [CrossRef] [Medline]
- Alsan M, Garrick O, Graziani G. Does diversity matter for health? Experimental evidence from Oakland. Am Econ Rev. 2019;109(12):4071-4111. [CrossRef]
- Jackson JL, Apilado KP, Koehlmoos TP. A review of reviews assessing patient-provider racial and ethnic concordance in mental health. J Racial Ethn Health Disparities. Jul 21, 2025. [CrossRef] [Medline]
- Henderson RC, Williams P, Gabbidon J, Farrelly S, Schauman O, Hatch S, et al. Mistrust of mental health services: ethnicity, hospital admission and unfair treatment. Epidemiol Psychiatr Sci. Jun 2015;24(3):258-265. [FREE Full text] [CrossRef] [Medline]
- Colvin K, Potts W, Heinlein E, Himelhoch S. Prevalence and predictors of medical mistrust among African Americans with serious mental illness receiving care in an urban setting. Community Ment Health J. Apr 2024;60(3):438-441. [CrossRef] [Medline]
- Holland S, Stocks D. Trust and its role in the medical encounter. Health Care Anal. Sep 2017;25(3):260-274. [CrossRef] [Medline]
- Smirnoff M, Wilets I, Ragin DF, Adams R, Holohan J, Rhodes R, et al. A paradigm for understanding trust and mistrust in medical research: the Community VOICES study. AJOB Empir Bioeth. 2018;9(1):39-47. [FREE Full text] [CrossRef] [Medline]
- Pederson AB, McLaughlin C, Hawkins D, Jain FA, Anglin DM, Yeung A, et al. Medical mistrust and willingness to use mental health services among a cohort of Black adults. Psychiatr Serv. Apr 01, 2025;76(4):318-325. [CrossRef] [Medline]
- Sullivan LS. Trust, risk, and race in American medicine. Hastings Cent Rep. Jan 2020;50(1):18-26. [CrossRef] [Medline]
- Lewis JE, Pride LC, Luk HG, Oyejide K, Wilson IM, Tawiah WE, et al. Aligning our actions with our words: a systematic review of gender and racial diversity in surgical subspecialties. J Med Access. Nov 02, 2024;8:27550834241293022. [CrossRef] [Medline]
- Yanos PT, Lucksted A, Drapalski AL, Roe D, Lysaker P. Interventions targeting mental health self-stigma: a review and comparison. Psychiatr Rehabil J. Jun 2015;38(2):171-178. [FREE Full text] [CrossRef] [Medline]
- Amsalem D, Jankowski SE, Pagdon S, Smith S, Yang LH, Valeri L, et al. "It's tough to be a Black man with schizophrenia": randomized controlled trial of a brief video intervention to reduce public stigma. Schizophr Bull. Apr 30, 2024;50(3):695-704. [CrossRef] [Medline]
- Heim E, Henderson C, Kohrt BA, Koschorke M, Milenova M, Thornicroft G. Reducing mental health-related stigma among medical and nursing students in low- and middle-income countries: a systematic review. Epidemiol Psychiatr Sci. Apr 01, 2019;29:e28. [FREE Full text] [CrossRef] [Medline]
- Amsalem D, Markowitz JC, Jankowski SE, Yang LH, Valeri L, Lieff SA, et al. Sustained effect of a brief video in reducing public stigma toward individuals with psychosis: a randomized controlled trial of young adults. Am J Psychiatry. Jul 2021;178(7):635-642. [CrossRef] [Medline]
- Chris Hubbard: tackling mental health stigma. NAMI YouTube page. URL: https://www.youtube.com/watch?v=sm3LlQv1cHc&list=PLlZf3Rbl5Ieq0fO4ZeKCJBhQamI7vI-bZ&index=10 [accessed 2026-03-27]
- From self-termination watch to recovery: "this isn’t me just being broken". NAMI YouTube page. 2021. URL: https://www.youtube.com/watch?v=OR-EW1Yr5tE [accessed 2026-03-27]
- Mental health stigma. caliclown5 YouTube page. URL: https://www.youtube.com/watch?v=CxJaThL-mV0&feature=youtu.be [accessed 2026-03-27]
- Bakken S, Grullon-Figueroa L, Izquierdo R, Lee NJ, Morin P, Palmas W, et al. Development, validation, and use of English and Spanish versions of the telemedicine satisfaction and usefulness questionnaire. J Am Med Inform Assoc. 2006;13(6):660-667. [FREE Full text] [CrossRef] [Medline]
- Brewer CF. Evaluating the readability of clinical trial content for patients on pharmaceutical company websites. Pharmaceut Med. Jan 2026;40(1):79-86. [CrossRef] [Medline]
- Brooke J. SUS: a 'quick and dirty' usability scale. In: Jordan PW, Thomas B, McClelland IL, Weerdmeester B, editors. Usability Evaluation in Industry. London, UK. CRC Press; 1996.
- Gao M, Kortum P, Oswald F. Psychometric evaluation of the USE (Usefulness, Satisfaction, and Ease of use) Questionnaire for reliability and validity. Proc Hum Factors Ergon Soc Annu Meet. Sep 27, 2018;62(1):1414-1418. [CrossRef]
- Boyd JE, Adler EP, Otilingam PG, Peters T. Internalized Stigma of Mental Illness (ISMI) scale: a multinational review. Compr Psychiatry. Jan 2014;55(1):221-231. [CrossRef] [Medline]
- Evans-Lacko S, Rose D, Little K, Flach C, Rhydderch D, Henderson C, et al. Development and psychometric properties of the reported and intended behaviour scale (RIBS): a stigma-related behaviour measure. Epidemiol Psychiatr Sci. Sep 21, 2011;20(3):263-271. [CrossRef] [Medline]
- Shelton RC, Winkel G, Davis SN, Roberts N, Valdimarsdottir H, Hall SJ, et al. Validation of the Group-Based Medical Mistrust Scale among urban Black men. J Gen Intern Med. Mar 2, 2010;25(6):549-555. [CrossRef]
- Ibrahim N, Amit N, Shahar S, Wee LH, Ismail R, Khairuddin R, et al. Do depression literacy, mental illness beliefs and stigma influence mental health help-seeking attitude? A cross-sectional study of secondary school and university students from B40 households in Malaysia. BMC Public Health. Jun 13, 2019;19(Suppl 4):544. [FREE Full text] [CrossRef] [Medline]
- Linardon J, Fuller-Tyszkiewicz M. Attrition and adherence in smartphone-delivered interventions for mental health problems: a systematic and meta-analytic review. J Consult Clin Psychol. Jan 2020;88(1):1-13. [CrossRef] [Medline]
- Clement S, Brohan E, Jeffery D, Henderson C, Hatch SL, Thornicroft G. Development and psychometric properties the Barriers to Access to Care Evaluation scale (BACE) related to people with mental ill health. BMC Psychiatry. Jun 20, 2012;12:36. [FREE Full text] [CrossRef] [Medline]
- Thompson HS, Valdimarsdottir HB, Winkel G, Jandorf L, Redd W. The Group-Based Medical Mistrust Scale: psychometric properties and association with breast cancer screening. Prev Med. Feb 2004;38(2):209-218. [CrossRef] [Medline]
- Valeri L, Vanderweele TJ. Mediation analysis allowing for exposure-mediator interactions and causal interpretation: theoretical assumptions and implementation with SAS and SPSS macros. Psychol Methods. Jun 2013;18(2):137-150. [FREE Full text] [CrossRef] [Medline]
Abbreviations
| CONSORT: Consolidated Standards of Reporting Trails |
| HIPAA: Health Insurance Portability and Accountability Act |
| IRB: institutional review board |
| RCT: randomized controlled trial |
| ROI: release of information |
| SPIRIT: Standard Protocol Items: Recommendations for Interventional Trials |
| SUS: System Usability Scale |
| USE: usefulness, satisfaction, and ease of use |
Edited by J Sarvestan; submitted 28.Aug.2025; peer-reviewed by E Toki, C Baxter; comments to author 06.Oct.2025; revised version received 22.Jan.2026; accepted 23.Jan.2026; published 28.Apr.2026.
Copyright©Aderonke Bamgbose Pederson. Originally published in JMIR Research Protocols (https://www.researchprotocols.org), 28.Apr.2026.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on https://www.researchprotocols.org, as well as this copyright and license information must be included.

